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Abstract — We introduce new reliability definitions for bit and 
check nodes. Maximizing global reliability, which is the sum 
reliability of all bit nodes, is shown to be equivalent to minimizing 
a decoding metric which is closely related to the maximum 
likelihood decoding metric. We then propose novel bit-flipping 
(BF) decoding algorithms that take into account the check 
node reliability. Both hard-decision (HD) and soft-decision (SD) 
versions are considered. The former performs better than the 
conventional BF algorithm and, in most cases, suffers less than 
1 dB performance loss when compared with some well known 
SD BF decoders. For one particular code it even outperforms 
those SD BF decoders. The performance of the SD version is 
superior to that of SD BF decoders and is comparable to or even 
better than that of the sum-product algorithm (SPA). The latter 
is achieved with a complexity much less than that required by 
the SPA. 

I. Introduction 

Low-density parity-check (LDPC) codes were first intro- 
duced by Gallager (T) in early 1960s and rediscovered by 
Mackay EJ (3] in 1990s. Soft-decision, hard-decision and 
hybrid decoding algorithms have been proposed for decoding 
LDPC codes. The sum-product algorithm (SPA) achieves the 
near-capacity performance asymptotically but its computa- 
tional complexity is very high. The min-sum algorithm (MSA) 
J5), which replaces the nonlinear check node operation by 
a single minimum operation, was proposed to reduce the 
complexity of the standard SPA at the cost of a noticeable 
degradation in the decoding performance. Chen and Fossorier 
IfTTl - lfrJl suggested the normalized min-sum algorithm and the 
offset min-sum algorithm which multiply and add a constant 
correction factor in the check-to-variable updating equation of 
MSA. They offer performance compatible to that of the SPA 
but with lower complexity. 

Bit-flipping (BF) decoding algorithm is a hard-decision 
decoding algorithm which is much simpler than SPA or its 
modifications but does not perform as well. To reduce the per- 
formance gap between SPA and BF based decoders, variants 
of the latter such as weighted bit-flipping (WBF) |7 |, modified 
weighted bit-flipping (MWBF) JH1 and improved modified bit- 
blipping (IMWBF) |9(| algorithms have been proposed. They 
provide tradeoffs between computational complexity and error 
performance. The reliability ratio based weighted bit-flipping 
(RRWBF) iflOl decoding algorithm needs not to find optimal 



parameters as variants of the WBF algorithm do but yields 
better performance. 

In this paper, we present novel bit-flipping algorithms called 
check reliability based bit-flipping (CRBF) decoding algo- 
rithms for decoding LDPC codes. Starting with the maximum 
likelihood (ML) decoding metric, we first relax the parity- 
check requirements and introduce a global cost which is 
the sum N local costs, where N is the codeword length. 
Interpreting each cost as the opposite of reliability, the bit(s) 
with maximal local cost or least reliability is (are) flipped in 
each decoding iteration. By reducing the local costs iteratively, 
we hope that the global cost can also be minimized to approach 
the ML cost. We define the reliability of a check node and use 
this reliability to modify and update the bit (node) reliabilities. 

Two CRBF algorithms are proposed: the soft check reliabil- 
ity based bit-flipping (soft-CRBF) algorithm, which processes 
the received channel values when decoding, and its hard de- 
cision counterpart which sends the hard-decision demodulated 
bit streams to the decoder. The soft-CRBF outperforms the 
WBF decoding algorithm and its variants and is comparable 
to SPA for some LDPC codes. We also compare the perfor- 
mance of the hard-CRBF and standard BF decoders and the 
simulation results prove that the former is a better choice. 

The rest of this paper is organized as follows. In Section 
III-AI we introduce the global and local costs as minimizing 
decoding costs and derive the relation between the global 
cost and the ML cost. The check node cost and reliability 
are defined in Section III-BI In Section III-C1 we describe the 
proposed CRBF algorithms, and in III-DI the cost functions 
of conventional WBF algorithms are examined. Section [III] 
discusses the computational complexities of the proposed 
algorithms, and Section|lV]provides some simulated numerical 
results concerning the performance of our and some well 
known algorithms. Finally, conclusion remarks are drawn in 
Section [V] 

II. Check Reliability Based Bit-Flipping Decoding 
Algorithms 

A. Cost Functions 

A regular binary (N, K) (d v , d c ) LDPC code C is a linear 
block code described by an M x N parity check matrix H 
which has constant column weight of d v and row weight of 
d c . H can be represented by a bipartite graph with N variable 



nodes corresponding to the encoded bits, and M check nodes 
corresponding to the parity-check functions represented by the 
rows of H. The code rate of C is given by 1Z = K/N. 

Assume BPSK signaling with unit energy is used. A code- 
word c = (cq, ci, . . . , cjv-i) is mapped into a bipolar se- 
quence c = (co, ci, . . . , cjv-i) and transmitted over an AWGN 
channel with noise variance a 2 . Let y = (yo, yi, 2/jv-i) 
be the corresponding received soft-decision sequence and 
the binary hard-decision sequence, z = (zo, zi, Zn-i), is 
obtained as follows: 
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which penalizes each violation Sj ^ 1 differently, (O imposes 
a constant penalty. 

© can be rewritten as 
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where 7 = ^- is also a positive constant. We accordingly 
define the ZocaZ cost (LC) for variable node i by 
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Let N(m) be the set of variable nodes that participate in 
check node m and Ai(n) be the set of check nodes that are 
connected to variable node n in the code graph. J\f(m)\n is 
defined as the set Af(m) with the variable node n excluded 
while M(n)\m is the set Ai(n) with the check node m 
excluded. 

Maximum likelihood (ML) decoding would find the unique 
bipolar vector x = argmax^gc Silo 1 ^i2/»> where the con- 
straint x G C is equivalent to Sj = Ylf^^j) 7 V < j < 
M — 1. Equivalently, the ML decoder solves the unstrained 
optimization problem 
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where are Lagrange multipliers. Although Qj's can be 
arbitrary real numbers the fact that each Sj can only take 
two values, +1 and -1, implies that they must be positive for 
otherwise the cost function will encourage the violation of the 
constraints §j = 1. Instead of solving the above ML problem 
we attack a simpler problem by relaxing the constraints and 
define a global cost (GC) associated with a candidate bipolar 
A^-tuple x as 
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where a > 0. The above cost replaces the multiple constraints 
{Sj — 1 = 0, i = 0, 1, • • • , M — 1} by the single constraint 

Sf=o 1 ^ = ^ ne seconc l term m tne above equation 
is used to penalizes each invalidate check relation and the 
penalty is minimized if x is a valid codeword. Unlike (01 
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and interpret the quantity — Ei, if positive, as the reliability 
of variable node i. Minimizing the global cost is thus equal 
to maximizing the total (variable node) reliability. Note that 
the LC's are not independent and related through s, unless 

M(i)nM(j) = 0,Vj^i. 

B. Reliability of a Check Node 

Given the reliability and local cost of a variable node, we 
now define the corresponding reliability and local cost of a 
check node by 
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R* nn is the maximum local cost amongst those of the variable 
nodes connecting to the check node m except node n. In other 
words, R* nn is used as a measure of the unreliability of the 
massage check node m intends to pass to variable node n. This 
unreliability is equal to the maximal cost of the variable nodes 
in jV(m)\n. If the maximum local cost (unreliability) is too 
high, ((TJ will return a constant zero, which means the check 
node m is totally useless for variable node n. In contrast, the 
reliability R mn is a positive weighting factor which indicates 
whether the check node (relation) m can provide proper 
reliability information for variable node n. Note that a bit- 
flipping on variable node i will result in a magnitude change 
of Ei. The maximum magnitude change is + 7|.M(£)|, 
where |.M(i)| denotes the cardinality of A4(i). The definition 
of the check reliability in (7) and (8) indicates this maximum 
magnitude change is also the maximum candidate value for 
Rmn which occurs when a incorrect bit decision is made and 
all check relations are violated. 



TABLE I 

A Soft Check Reliability Based Bit-Flipping Decoding 
Algorithm 



Initialization: 

Set I = 0, x° <— z, compute s°. 

Let R% = l,Vie Af(j), 0<j< M. 

E? = -Vi - 7 EjeM(i) S r for ^ 1 < N - 
Step 1: 

1 = 1 + 1. x\ = x'r 1 , 0<i< N. 

e = argmax.; M -1 , then let ig = — i^T 1 - 

Step 2: 

Compute s l . If s' = or Z = / maa: , stop decoding 
and output x l as the decoded sequence. Otherwise, 
go to step 3. 
Step 3: 

Vi 6 and < j < M, compute R 1 ^. 

Step 4: 

For < i < N, compute E\ and go to step 1. 



C. Check Reliability Based Bit-Flipping Decoding Algorithms 

When using an iterative algorithm to find the minimum GC, 
x i and Sj are replaced by their Zth iteration values x\ , s\ in 
computing (O. To use the check reliability information we 
update the LC at the Zth iteration by 

U» • - £ (9) 

where 

R^i = max(-iZ$,0) (10) 

is the reliability of check node j for variable node i in the Zth 
iteration and 

R*\ = max 1 - is 1 ' 1 i?' " 1 . (11) 

i'&N{j)\i 1 31 

is the modified unreliability of the check node j for variable 
node i. Since 7 > 0, (O and ( fTTT i indicate that we have put 
larger weights on more reliable checks. 

The basic procedure of the proposed CRBF decoding al- 
gorithms works as follows. At each iteration we flip the 
decision bit(s) which is (are) most unreliable (largest LC) 
first, calculate the reliability of each check node, and update 
the LC of each variable node if needed. The procedure stops 
if a validate codeword is found or if the maximum number 
of iterations I max is reached. The soft CRBF (soft-CRBF) 
decoding algorithm is summarized in Table I. 

If we replace yi with zi in the Step 4 of Table I, the 
resulting algorithm is called the hard CRBF (hard-CRBF) 
decoding algorithm. 

D. Cost Functions of Known WBF Decoding Algorithms 

For the weighted bit-flipping (WBF) decoding, the cost 
function or the objective function for x\ in the Zth iteration 



is defined by 
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where 

Wj ! i= min l^/]. (13) 

For modified WBF (MWBF) and improved modified WBF 
(IMWBF) decoding algorithms, the cost functions for x\ in 
the Zth iteration is defined by 

e Imwbf - - §l j ' w i l ~ \ y *\ (14) 

and 
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respectively, where a is a positive constant and can be op- 
timized by simulations. The bit with maximal cost will be 
flipped in the WBF, MWBF and IMWBF decoding algorithms. 

III. Computational Complexity 

For the proposed algorithm, each decoding iteration con- 
sists of check-reliability and the cost updates. The number 
of check-reliability updates in the proposed algorithms is 
highly dependent on the node degrees of the code used. 
Suppose only one bit is flipped in each iteration, we will need 
min{ M + 1 , d v ■ (d c — 1) + 1} standard operations, each includes 
the check-reliability updates and the selection of the bit with 
the maximum local cost, in one iteration. min{iV, d v ■ d c } cost 
calculations are also needed. 

For the WBF, MWBF and IMWBF decoding algorithms, 
Wj.i is used to adjust the reliability of check node j for variable 
node i. Wjj will not be modified in the course of iterative 
decoding, so the computational complexity is lower than that 
of the proposed algorithms. The standard BF algorithm can be 
regarded as a special case of the WBF decoder with Wj i = 
1, which has the lowest complexity but gives relatively poor 
performance. 

IV. Numerical Results 

Computer-simulated bit error rate (BER) performance of 
various BF decoding methods, SPA and proposed decoding al- 
gorithms are reported in this section. Mackay's (504,252)(3,6) 
0.5-rate LDPC code, (255,175)(16,16) 0.69-rate EG-LDPC 
code, the (1440,1344)(3,45) 0.93-rate LDPC code defined in 
802.15.3c and the (2048,1723)(6,32) 0.84-rate LDPC code 
defined in 802.3a/n are used for comparison in our simulations. 

Figd depicts the BER performance of the standard BF, 
WBF, MWBF, soft-CRBF and hard-CRBF decoding algo- 
rithms with I m ax = 30. The performance of IMWBF decoding 
is not shown in this figure because the optimal parame- 
ter value for a equals to 1, that is, the two algorithms, 
IMWBF and MWBF, become identical for this code. The 
proposed soft-CRBF algorithm outperforms the SPA, WBF 
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Fig. 1. BER performance of the (255,175)(16,16) LDPC code using different 
decoding methods: SPA, BF, WBF, MWBF, IMWBF, hard-CRBF and soft- 
CRBF algorithms. 



Fig. 3. BER performance of the (1440,1344)(3,45) LDPC code using the 
SPA, BF, WBF, MWBF, IMWBF, hard-CRBF and soft-CRBF algorithms. 
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Fig. 4. BER performance of the (2048,1723)(6,32) LDPC code with the 
Fig. 2. BER performance of the SPA, BF, WBF, MWBF, IMWBF, hard- SPA, BF, WBF, MWBF, IMWBF, hard-CRBF and soft-CRBF algorithms. 
CRBF and soft-CRBF decoding algorithms for the (504,252)(3,6) LDPC code. 



and MWBF by about 0.35 dB, 0.5 dB, and 0.8 dB, respec- 
tively at BER= 10~ 5 . The hard-CRBF decoding algorithm 
outperforms the standard decoding algorithm, which is also 
a pure hard-decision decoding algorithm, by about 0.5 dB at 
BER= 4 x 10~ 4 . 

Performance curves in Fig. |2] show that at BERps 10 -4 , the 
proposed soft-CRBF algorithm gives 3 dB perform gain with 
respect to the variants of WBF algorithms. The hard-CRBF 
algorithm offers 2 dB perform gain against the standard BF 
decoder at BER= 2 x 10~ 4 and provides better performance 
than the variants of WBF algorithms; I m ax being set as 70 for 
this code. 

Fig. [3] compares the BER performance of the SPA, variants 
of the WBF algorithm, and the proposed algorithms with 



Imax = 30. The soft-CRBF decoding algorithm outperforms 
the IMWBF and the MWBF decoders by about 0.9 dB at 
BER= 10~ 5 and yields 1.3 dB gain against the WBF decoder 
at the same BER. The hard-CRBF decoding algorithm is about 
0.6 dB better than the standard BF at BER= 1.2 x 10~ 5 . 

Fig. Vindicates that the proposed soft-CRBF decoder yields 
near-SPA performance and outperform the WBF, MWBF and 
IMWBF decoder by a margin larger than 1 dB at BER= 10~ 5 . 
The hard-CRBF not only outperforms the standard BF but is 
also superior to the MWBF and IMWBF algorithms at BER= 
10~ 6 when I rnax = 70. 

V. Conclusion 

We have presented two novel check reliability based soft- 
decision bit-flipping decoding algorithms to improve the per- 



formance of the WBF algorithm and its variants for decoding 
LDPC codes. At each iteration, the cost/reliability for each 
bit is computed and the bit with least reliability is flipped. 
The check reliability is also defined for each check node and 
is used to update the related bit node reliabilities. The sum 
of bit cost/reliability is shown to be a relaxed version of the 
ML decoding metric. Our algorithms are iterative approaches 
for minimizing the sum reliability. Numerical results show that 
the proposed soft-decision decoding algorithm outperforms the 
conventional WBF algorithm and its variants. On the other 
hand, the hard-decision version outperforms the standard bit- 
flipping decoder and, for some codes, even offers performance 
better than that of the WBF decoding algorithm. 
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